Learn When To Let It Go